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SYSTEM FOR TRANSMITTING VIDEO IMAGES OVER A 
COMPUTER NETWORK TO A REMOTE RECEIVER 



FIELD OF THE INVENTION : 
5 The present invention relates to the field of communications systems. More 

particularly, the present invention relates to the field of video communications systems 
transmitting video data from a source device to a receiving device. 

BACKGROUND OF THE INVENTION : 

In the last decade, there have been tremendous advances in medical devices which 
=P have greatly improved the ability to diagnose and treat patients. Ultrasounds, sonograms and 
ifl echocardiograms are just a few modern tools developed to accurately diagnose patients with 

coronary problems, kidney stones, tumors, and other diseases without conducting risky and 
I iJ expensive exploratory surgeries. These tools are especially useful because they have the 
15, capability of being more accurate than exploratory surgeries and do not pose an additional risk 
;IJ to patients. 

:3 Given the benefits of ultrasounds, sonograms and echocardiograms these tools are in 

:S widespread use in many hospitals, clinics, testing facilities, and individual doctors' offices. 
Many doctors primarily base their diagnosis on the results from ultrasounds, sonograms and 

20 echocardiograms. While these tools allow doctors to make their diagnosis without costly, 
risky, and time consuming exploratory surgeries, an error in administering an ultrasound, 
sonogram and echocardiogram can lead to a wrong diagnosis. A wrong diagnosis can be 
catastrophic for the patient. By receiving an incorrect diagnosis, the patient can potentially 
fail to receive needed medical treatment and/or be unnecessarily treated. Whether needed 

25 medical treatment is withheld or unnecessary medical treatment is given due to an erroneous 
test result from an ultrasound, sonogram and echocardiogram, the patient unnecessarily 
suffers. 
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The doctor is generally not at the test when the study is performed on the patient. The 
tests are typically performed and later reviewed by the doctor after the patient has left the 
technician's office. The test is recorded in a video or movie format and then later played by 
the doctor to make their diagnosis. 

A video picture or frame is made up of a number of horizontal lines included within 
the video display. To display a video picture or frame the video system begins at the top of 
the screen and displays the information within the composite video signal one horizontal line 
at a time. The information for each horizontal line is contained within a horizontal period of 
the composite video signal. After each horizontal period, the video system moves to the next 
line and displays the information within the next horizontal period of the composite video 
system. This continues until the video system reaches the bottom line on the video display. 
After displaying the video information on the bottom line of the video display, the video 
system must reset itself to the top of the display in order to begin displaying the next frame. 
In order to allow the system to reset itself to the top of the video display a vertical blanking 
period is included within the composite video signal, after the video information for each 
frame. This vertical blanking period allows the video system to reset to the top of the video 
display and begin displaying the information for the horizontal lines of the next frame. 
Therefore, a number of horizontal periods, enough to comprise a frame or screen, are strung 
together, within the composite video signal. Between each frame, the composite video signal 
includes a vertical blanking period which allows the video system to perform a vertical reset 
and prepare to display the next frame by moving back up to the top of the video display. 

A schematic block diagram of a typical configuration including a display device 10 
and an external image source 12 coupled together through a network 14 is illustrated in 
Figure 1. The network 14 can be an intranet connection, internet cormection or a direct 
connection between the display device 10 and the external image source 12. A user can view 
a movie or stream of video frames at the display device 10 which is transmitted from the 
source device 12. Currently, such a video stream can be transmitted from the source device 
12 to the display device 10 in a number of ways. In order to view a movie transmitted from 
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the soiirce device 12, at the display device 10, in typical systems, the entire video stream of 
frames within the movie is transmitted and stored at the display device 10 and then viewed by 
the user. This method has the disadvantage that it can be very time consuming, because it 
requires that the entire movie is sent to the display device 10, before viewing of the movie 
can begin at the display device 10. Depending on the size of the movie and the speed of the 
connection between the display device 10 and the source device 12, this can be a significant 
delay from the time the video stream is transmitted until the user can start watching the movie 
at the display device 10. 

In another prior system, frames of the movie are sent interactively as the movie was 
recorded. This has the disadvantage or requiring the movie to be transmitted in the format in 
which it was recorded. This format may not be suitable for efficient transmission. This 
system also has the disadvantage that the movie is not stored at the display device 10 and 
must be re-transmitted for each viewing. 

In still another prior system, frames of the movie are interactively transcoded to a 
storage-efficient encoding format either before transmission or as the frames are being 
transmitted. This system has the disadvantage of not allowing the viewer to see frames of the 
movie as originally recorded. Depending on the encoding format used, a user of such a 
system may notice a significant decrease in image quality. This system also has the 
disadvantage that the movie is not stored at the display device and must be re-transmitted for 
each viewing. 

SUMMARY OF THE INVENTION : 

A method of and apparatus for transmitting video images allows a viewer to receive at 
a receiving display device, all or a selected portion of a video stream of frames, in a storage- 
efficient format from a transmitting device and view the received video stream of frames 
before the transmission is complete. The video system also allows a viewer to receive at the 
receiving device, all or a selected portion of a video stream of frames, in a high-resolution 
format, by marking sections of interest within the received stream of frames in the storage- 
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efficient format and requesting enhancement of those marked sections of interest. This 
apparatus preferably includes a source device, a transmitting device and at least one receiving 
device. Preferably, the transmitting device and the receiving device communicate over a 
network such as the Internet Protocol network. Alternatively, the transmitting device and the 
receiving device communicate over any appropriate data network. The transmitting device 
transmits the video images to the receiving device for display and storage at the receiving 
device. The receiving device is also capable of communicating with the transmitting device 
while simultaneously receiving video images. The source device is preferably a medical test 
device such as an ultrasound, a sonogram, an echocardiogram, and the like. Alternatively, the 
source device can be any video capture or storage device capable of sourcing a stream of 
video frames. 

In one aspect of the present invention, a method of transmitting a video stream of 
images from a source device to a receiving device includes the steps of transmitting the video 
stream of images in a first format to the receiving device, receiving a request for an enhanced 
version of a marked portion of the video stream of images from the receiving device and 
transmitting the marked portion of the video stream of images in a second format, wherein the 
second format represents an enhanced version of the first format. The method further 
includes the step of storing the original video stream of images at the receiving device. The 
method further includes the step of storing the marked portion of the video stream of images 
to replace a corresponding portion of the original video stream of images. The method 
further includes the step of generating the video stream of images and transmitting the video 
stream of images to the source device. Preferably, the step of generating is performed by a 
medical test device which is one of the group of an ultrasound, sonogram and echocardiogram 
device. The method further includes the step of displaying the video stream of images at the 
receiving device. The method further includes the step of marking the marked portion of the 
video stream of images at the receiving device. The step of displaying includes a fast-forward 
and rewind function. The step of transmitting the video stream of images and the step of 
displaying are performed simultaneously such that a received portion of the video stream of 
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images is displayed while a remaining portion of the video stream of images is transmitted. 
The method further includes the step of adding annotations to the video stream of images. 
The method further includes the step of determining if a user views a particular image within 
the video stream of images for a predetermined period of time and automatically transmitting 
the particular image in the second format. If the request for an enhanced version is received 
while the step of transmitting the video stream of images is being performed, then the step of 
transmitting the video stream of images is paused while the step of transmitting the marked 
portion is performed, and resumed once the step of transmitting the marked portion is 
completed. 

In another aspect of the present invention, a transmitting device for transmitting a 
video stream of images to a receiving device includes a storage device configured for 
receiving and storing a stream of images and a controller coupled to the storage device and 
configured for coupling to the receiving device for controlling transmission of the stream of 
images from the storage device to the receiving device, wherein the stream of images are 
transmitted to the receiving device in a first format and then a requested portion of the stream 
of images are transmitted to the receiving device in a second format, and further wherein the 
second format represents an enhanced version of the first format. The transmitting device 
further includes a source device coupled to the storage device for generating the stream of 
images and transmitting the stream of images to the storage device. The source device is 
preferably a medical test device which is one of an ultrasound, a sonogram and an 
echocardiogram. The transmitting device further includes a network interface circuit coupled 
to the storage device and to the controller for communicating with the receiving device over a 
network. The receiving device includes a display for displaying the stream of images and an 
input device for marking the requested portion of the stream of images. The network is 
preferably an Internet Protocol network. Received frames within the stream of images are 
displayed at the receiving device while a remaining portion of the stream of images is 
transmitted. The receiving device further includes a received storage device for storing the 
stream of images. The requested portion of the stream of images is stored in the second 
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format and a remaining portion of the stream of images is stored in the first format at the 
received storage device. 

In yet another aspect of the present invention, a system for transmitting a video stream 
of images from a soin-ce device to a receiving device includes a source device for generating 
the video stream of images, a transmitting device coupled to the source device to receive and 
store the video stream of images and a receiving device coupled to the transmitting device to 
receive the video stream of images in a first format, display the video stream of images for a 
user to mark one or more sections of interest, transmit a request for an enhanced version of 
the sections of interest and receive from the transmitting device the sections of interest within 
the video stream of images in a second format, wherein the second format represents an 
enhanced version of the first format. The source device is preferably a medical test device 
which is one of an ultrasound, a sonogram and an echocardiogram. The receiving device is 
coupled to the transmitting device through a network. The receiving device includes a display 
for displaying the stream of images and an input device for marking the requested portion of 
the stream of images. The receiving device further includes a received storage device for 
storing the video stream of images. The sections of interest within the video stream of 
images are stored in the second format and a remaining portion of the video stream of images 
is stored in the first format at the received storage device. Received frames within the video 
stream of images are displayed at the receiving device while a remaining portion of the video 
stream of images is transmitted. 

In still another aspect of the present invention, a method of transmitting a video stream 
of images from a source to a receiving device for display and storage at the receiving device 
includes the steps of transmitting the video stream of images in a first format to the receiving 
device, displaying the video stream of images in the first format at the receiving device, 
allowing a user to mark sections of interest within the video stream of images and 
transmitting the sections of interest to the receiving device in a second format, wherein the 
second format represents an enhanced version of the first format. The method further 
includes the step of displaying the sections of interest in the second format at the receiving 
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device. The method further includes the step of storing the sections of interest in the second 
format and a remaining portion of the video stream of images in the first format at the 
receiving device. The step of transmitting the video stream of images and the step of 
displaying the video stream of images in the first format are performed simultaneously, such 
5 that a received portion of the video stream of images is displayed while a remaining portion 
of the video stream of images is transmitted. The step of displaying includes a fast-forward 
and rewind function. The method further includes the step of generating the video stream of 
images and transmitting the video stream of images to the source device. The step of 
generating is preferably performed by a medical test device which is one of a group of an 
ultrasound, sonogram and echocardiogram device. 

II! BRIEF DESCRIPTION OF THE DRAWINGS : 

Figure 1 illustrates a schematic block diagram of a typical configuration including a 
lU display device and an external image source coupled together through a network. 

Figure 2 illustrates a block diagram of a video system according to the present 
;!! invention for transmitting video images from one location to another. 

II DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT : 

The video system of the present invention includes a video source device, such as an 

20 ultrasound, sonogram or echocardiogram device, which generates video images. A 

transmitting device coupled to the video source device receives and stores the video images in 
collections or movies. The transmitting device is also configured to be coupled to a server 
and one or more receiving devices through a network for transmitting the captured movies. 
The transmitting device can either transmit the movies directly to a receiving device or to the 

25 server for storage. If stored at the server, a receiving device can access the server through the 
network to download a movie. 

When downloaded from either the server or the transmitting device to a receiving 
device, the frames are first transmitted in a low-resolution, storage-efficient format. A user 
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can view received frames in the storage-efficient format, at the receiving device, as the 
remaining frames within the movie are being transmitted. The user can also mark sections of 
interest within the movie as they are viewing the movie. When the user then activates an 
enhance function, the frames within the marked sections of interest are sent from the server or 
5 transmitting device to the receiving device in an enhanced, high-resolution format for viewing 
by the user at the receiving device. 

As frames are received at the receiving device, the data representing the frames is 
stored at the receiving device. If an enhanced, high-resolution version of a frame is received 
at the receiving device, the enhanced, high-resolution version of the frame is saved over the 
W storage-efficient format of the frame which was previously received. 
£ Figure 2 illustrates a video system 100 according to the present invention for 

:J transmitting video images from one location to another. The video system 100 preferably 
S includes a video source 101, a video cassette recorder 102, a transmitter 103, a recorded video 
ill device 104, a computer network 105, a server 150, a plurality of receivers 106, and data links 
15, 110, 115, 120, 125 and 145. Preferably, the video source 101 includes the video cassette 

recorder 102 or other storage means, such as a hard disk or writable CD-Rom, and is coupled 
m to the transmitter 103 via the data link 110. The data link 110 is preferably a Super- Video 
(S- Video) connection. The transmitter 103 is also preferably coupled to the recorded video 
device 104 and the computer network 105 via the data hnks 115 and 120, respectively. 
20 Preferably, the server 150 is coupled to the computer network 105 through the datalink 

145. Preferably, the plurality of receivers 106 are coupled to the computer network 105 via 
the data links 125. Each of the plurality of receivers 106 are preferably a computer system 
having a display, central processing unit, and input device. The data links 120, 125 and 145 
preferably link each of the plurality of receivers 106 to the computer network 105. The data 
25 links 125 include any appropriate connection to the computer network 105 including Tl 

communication lines, DSL links, cellular hnks, microwave transmission, land Unes, twisted 
pair cable, and the like. The video system 100 shown in Figure 2 is merely illustrative and is 
only meant to show the preferred embodiment of the present invention. In alternate 
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PATENT 
ICOM-00600 

embodiments, additional servers, transmitters, video sources, and receivers could be included 
without departing from the spirit and scope of the video system 100. 

The video source 101 preferably provides the video system 100 with at least one video 
image. The video source 101 is capable of providing either a real-time video image or a pre- 
5 recorded video image. For example, to provide a real-time video image, the video source 101 
preferably includes a real-time input device 130. This real-time input device 130 is preferably 
a medical measurement device such as an ultrasound, sonogram and echocardiogram, and the 
like. Alternatively, this real-time input device 130 could be any other appropriate image 
capturing device including a video camera and a still camera. The pre-recorded video image 
iP is preferably provided by the storage device 102. Preferably, the storage device 102 is 

configured to record the real-time video images produced by the real-time input device 130 
% and play these pre-recorded video images at a later time. In addition to recording real-time 
+^ video images and re-playing them, the video cassette recorder 102 is also preferably 
nj configured to accept and play a pre-recorded video cassette tape. The video source 101 is 
I'§ preferably configured to transfer the video image to the transmitter 103 via the data link 110. 
\^ The recorded video device 104 is preferably coupled to the transmitter 103 via the data 

;Yl link 115. Preferably, the recorded video device 104 stores video images received by the 
5; transmitter 103 for playback at a later time. The recorded video device 104 allows the 

transmitter 103 to distribute these video images to the server 150 and the plurality of receivers 
20 106 at a later time. In addition, the recorded video device 104 also preferably serves as a 
mass storage device to store data that is unrelated to the video images. 

The transmitter 103 preferably controls the flow of video images from both the video 
source 101 and the recorded video component 104 over the computer network 105 to any 
number of the plurality of receivers 106, directly, or to the server 150. The transmitter 103 
25 preferably compresses the video images in any known format prior to transmission to one of 



- 9 - 



PATENT 
ICOM-00600 

the plurality of receivers 106 or to the server 150. Further, the transmitter 103 preferably 
monitors and selectively establishes connections with the computer network 105 over the data 
link 120. 

In the video system 100, the computer network 105 is preferably an Internet Protocol 
5 network. In alternate embodiments, the computer network 105 is any appropriate data 

network, including a direct connection. The computer network 105 is configured to transmit 
information between the server 150, the plurality of receivers 106 and the transmitter 103. 

The plurality of receivers 106 are preferably configured to selectively receive a stream 
of video images from the transmitter 103 or from the server 150 over the computer network 
If 105. For example, at least one of the plurality of receivers 106 is programmed to receive a 
:C stream of video images from the transmitter 103 or from the server 150. Accordingly, only 
the selected ones of the plurality of receivers 106 are capable of receiving the stream of video 
images from the transmitter 103 or from the server 150. In addition to receiving the stream 
ill of video images, the selected ones of the plurality of receivers 106 are also capable of 

transmitting instructions to the transmitter 103 or to the server 150 over the computer network 
t 105. 

;g The plurality of receivers 106 preferably reside in a remote location relative to the 

[% transmitter 103 and the server 150. Preferably, the pluraUty of receivers 106 selectively 
receive the flow of video images from the transmitter 103 or the server 150 and also 

20 selectively respond to the transmitter 103 or the server 150 with instructions. 

Each of the plurality of receivers 106 preferably includes a video controller, a video 
client, and a video play device. Preferably, the video controller relays information regarding 
the frame size, frame rate, compression algorithm, and other parameters being transmitted to 
the transmitter 103 or to the server 150, as appropriate. Thus, a user interfacing with one of 

25 the plurality of receivers 106 is able to modify the frame size, frame rate, compression 
algorithm, and other parameters of the incoming stream of video images to one of the 
plurality of receivers 106, Since the plurality of receivers 106, the transmitter 103 and the 
server 150 are preferably located in remote locations, by interfacing with the video controller 
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of the receiver 106, the user is able to remotely control video parameters such as frame size, 
frame rate, compression algorithm, and the like which are included within the video settings 
at the transmitter 103 or the server 150. 

The receiving device 106 preferably receives the compressed stream of video images 
from the server 150 or the transmitter 103. The video client within the receiving device 106 
preferably includes a decompressor which is configured to decompress the compressed stream 
of video images to form a representation of the original, uncompressed stream of video 
images. After the compressed stream of video images is processed by the decompressor, the 
resulting stream of video images is ready to be displayed. 

In operation, when transmitting directly to the receiving devices 106, the transmitter 
103 acts as a server that is connected to an appropriate data network. For most movies 
captured by the transmitter 103, within the preferred embodiment of the present invention, the 
transmitter 103 will transmit the movies for storage at the server 150. The server 150 then 
will transmit the movies to the receiving devices 106, as appropriate, when the receiving 
devices 106 access the server 150 over the computer network 105. 

Preferably, each of the plurality of receivers 106 individually acts as a stand-alone 
computer system connected to the data network. The server 150 selectively enables a data 
stream of video images to be transmitted to an appropriate one or more of the plurality of 
receivers 106. In order for a particular receiver 106 to receive the data stream of video 
images from the transmitter 103, the receiver 106 logs onto the server 150 through the 
computer network 105. Preferably, the computer network 105 is the Internet Protocol 
network. Alternatively, the computer network 105 is any appropriate data network. 
Typically, in the preferred embodiment, this log on is accomplished by connecting through an 
Internet service provider. A connection between the server 150 and the particular receiver 
106 is preferably established through the computer network 105 (Figure 1). The particular 
receiver 106 preferably communicates with the server 150 over the computer network 105 and 
furnishes a user identification, a password, or another form of identification and verification. 
Once the server 150 identifies the particular receiver 106 as an approved user, the server 150 
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allows the data stream of video images to be transmitted to the particular receiver 106 over 
the computer network 105. The transmitter 103 is capable of simultaneously transmitting the 
data stream of video images to multiple receivers 106, if appropriate. 

When receiving a movie or recorded stream of video images from either a transmitter 
103 or the server 150, utilizing the video system of the present invention, a receiving device 
106 receives all or a selected portion of the movie in a storage-efficient format. This storage- 
efficient format allows a faster transmission of the movie from either a transmitter 1 03 or the 
server 150 to a receiving device 106, but provides the user a lesser quality video picture when 
displayed on the receiving device 106. The user then views the movie in this storage-efficient 
format in order to determine if there are portions of the movie that the user wants to see in an 
enhanced format. The user does not have to wait for the entire movie to be received, but can 
begin viewing the transmitted frames in the storage-efficient format as the remaining video 
frame data within the movie is being transmitted to the receiving device 106. 

While viewing the movie in the storage-efficient format, the user can mark portions of 
the movie, referred to herein as sections of interest, to receive in an enhanced, high-resolution 
format. The receiving device 106 then transmits a request to the appropriate one of the 
transmitting device 103 or the server 150 to receive the frames within the marked sections of 
interest in an enhanced, high-resolution format. In response to this request, the transmitting 
device 103 or the server 150 transmits the frames within the marked sections of interest in the 
high-resolution format. The user can then view the frames within the sections of interest in 
this high-resolution format. The user can also begin viewing transmitted enhanced frames 
while the remaining enhanced frames within the section of interest are being transmitted. 

If the request for enhanced frames within a section of interest occurs while the transfer 
of portions of the movie in the storage-efficient format is being completed, then the transfer 
of frames within the storage-efficient format is preferably interrupted until the enhanced 
frames are transferred. After the enhanced frames within the sections of interest have been 
transferred, the transfer of frames within the storage efficient format is then resumed from the 
point that it was interrupted. 

- 12 - 
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The receiving device 106 also preferably stores a local copy of the movie that is 
received from either the transmitting device 103 or the server 150, including both the storage- 
efficient frames and the enhanced frames within the sections of interest. When enhanced 
frames within a section of interest are received the enhanced frames are stored over the 

5 corresponding previously received frames in the storage-efficient format. Accordingly, the 
local copy of the movie will include frames in the enhanced format in marked sections of 
interest and frames within the storage-efficient format in the remaining portions of the movie. 
A user can use controls such as play, pause, fast-forward, reverse-play, rewind, skip to next 
mark and skip to previous mark, to interactively control the portion of the movie that is 
currently being displayed at the receiving device 106. 
p Preferably, a transmitting device 103 or server 150, for transmitting video frames to a 

receiving device 106, includes an open function which establishes a connection between a 

=t receiving device 106 and a movie stored at the transmitting device 103 or the server 150. 

m The transmitting device 103 or server 150 also includes a transfer frames function which 

V5 transfers a specified range of frames within a movie, encoded using a specified encoding 

]^ scheme, to the requesting receiving device 106. 

Preferably, a receiving device 106 for receiving video frames from a transmitting 

y device 103 or the server 150 includes an open function which requests a connection to a 

movie stored on the transmitting device 103 or the server 150. The receiving device 106 also 

20 includes a mark-in function, used to establish a beginning or in-point of a section of interest 
within a movie to be transferred, and a mark-out function, used to establish an end or out- 
point of the section of interest to be transferred. The receiving device 106 also includes an 
enhance function which is used to request from the transmitting device 103 or the server 150, 
an enhanced, high-resolution copy of the frames between the in-point mark and the out-point 

25 mark, denoting the section of interest previously established by the user. As discussed above, 
the receiving device 106 also includes transport control functions such as play, pause, fast- 
forward, reverse-play, rewind, skip to next mark and skip to previous mark, which are used to 
control the display of frames within the movie being displayed. 
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The receiving device 106 also includes a status display function w^hich displays the 
status of each frame of the movie, as it is being displayed, as well as the current position of 
the player and the location of any flags or markers in the movie. The status of a frame is one 
of either transferred, specifying that the frame has already been transferred from the 
transmitting device, not-transferred, specifying that the frame has not yet been transferred 
from the transmitting device or enhanced, specifying that the enhanced, high-resolution 
version of the frame has been transferred from the transmitting device. The receiving device 
106 also includes an accept frames function which accepts frames sent from the transmitting 
device 103 or the server 150 and stores them in a local copy of the movie which is built 
interactively. When the connection to the transmitting device 103 or the server 150 is 
eventually closed, the local movie stored at the receiving device 106 is a valid movie which 
may be replayed on the receiving device 106 at any time. In this stored local copy, if 
enhanced versions of frames were received, then the enhanced versions of frames are 
preferably saved to replace the previously received storage-efficient version of the frames. 
Alternatively, both versions of frames are saved in the local copy at the receiving device 106. 

The storage-efficient format in which the video frames of a movie are first transmitted 
from the transmitting device 103 or the server 150 to the receiving device 106 is a low- 
resolution format which allows the video frames to be transmitted much faster between the 
transmitting device 103 or the server 150 and the receiving device 106. In the preferred 
embodiment of the present invention, the storage-efficient format requires 150 kbytes per 
second. The storage-efficient format is a trade-off between speed and quality. Frames in this 
format can be transferred faster than in the high-resolution format, but the quality of the 
frames, when displayed, is poorer, due to the lower resolution. However, preferably, the 
quality of frames in the storage-efficient format is good enough to allow the viewer to see the 
basic images within the frame and determine whether or not they would like an enhanced 
version of the frame. 

The enhanced, high-resolution format in which marked sections of interest are 
transmitted from the transmitting device 103 or the server 150 to the receiving device 106 
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takes longer to transmit than frames within the storage-efficient format. However, when 
displayed, the quality of frames in the enhanced, high-resolution format is much greater than 
in the storage-efficient format. In the preferred embodiment of the present invention, the 
enhanced, high-resolution format requires 2.5 Mbytes per second. 

Used together, the storage-efficient format and the enhanced, high-resolution format 
allow a user to quickly and effectively determine sections of interest within the movie where 
they would like to see frames in the enhanced format. The storage-efficient format allows the 
video frames within the movie to be transmitted to the receiving device 1 06 faster to give the 
user an opportunity to watch the movie at the receiving device 106 and determine and mark 
sections of interest within the movie. The frames between the marked sections of interest are 
then sent in the enhanced, high-resolution format and stored with the movie to replace the 
relevant frames. The user can view these enhanced, high-resolution frames within the sections 
of interest. In this manner, the entire movie is not sent in the enhanced format, but only the 
frames within the sections of interest. A local copy of the movie is stored at the receiving 
device 106 which includes the enhanced, high-resolution frames within the sections of interest, 
and frames in the storage-efficient format in the remaining portions of the movie. 

In an alternate embodiment of the present invention, multiple levels of enhancement 
are utilized. In this embodiment, the system remembers the enhancement level of each frame 
which has been downloaded. When a user marks a section of interest, frames within that 
section are then transmitted at the next enhancement level. The user can keep enhancing the 
section of interest, as appropriate, until either the highest enhancement level is transmitted or 
the user is satisfied with the quality of the frame, as displayed. 

In an alternate embodiment of the present invention, the system automatically enhances 
the current image or section of images. In this embodiment, if the user lingers on a particular 
frame or group of frames for more than a predetermined time period, then the system 
automatically transmits the enhanced, high-resolution version of the frame or group of frames. 

In the preferred embodiment of the present invention, the frames within the movie are 
downloaded sequentially in the storage-efficient format. In an alternate embodiment of the 
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present invention, the system is not limited to a sequential download of the frames in the 
storage-efficient format. In this alternate embodiment, if the user sets the current position of 
the movie player to a point beyond all downloaded content, the system automatically begins 
downloading the frames at that chosen location in the movie in the storage-efficient format. 
The system will then later return to the skipped portion of the movie and download the 
frames within that portion. 

In an alternate embodiment of the present invention, a user can stop or pause the 
downloading of a movie from a transmitting device 106 or the server 150 to a receiving 
device 106 at any time. In this embodiment, the user can then later resume the downloading 
of the movie at the point at which the downloading was previously stopped and with all 
previously enhanced sections retaining their enhanced status and content. 

In an alternate embodiment of the present invention, a user can add annotations to the 
movie stored at the receiving device 106 and have those annotations sent to the transmitting 
device 103 or the server 150, as appropriate, and stored in the original movie file. This 
allows a user to annotate a movie which others download and view with the annotations. 

In operation, within the system of the preferred embodiment of the present invention, a 
user at a receiving device 106, selects a movie to be viewed from a list of movies available 
on a remote transmitter 103 or server 150. Once the selection is made, the receiving device 
106 automatically makes a request to the transmitter 103 or the server 150 to transfer all 
frames within the movie in the storage-efficient format. The user can begin to playback and 
view the movie at the receiving device 106 as soon as any frames are received, while the 
remainder of the movie is being downloaded. As the user plays or positions through the 
movie, the user uses the mark-in and mark-out functions to mark sections of interest within 
the movie. The user can position through the movie using the fast-forward, reverse-play, 
rewind, skip to next mark and skip to previous mark functions. The user then uses the 
enhance function to request transfer of the frames within the marked sections of interest in an 
enhanced, high-resolution format from the transmitter 103 or the server 150, When received 
at the receiving device 106, the frames in the enhanced, high-resolution format are saved to 
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replace the previously received corresponding frame in the storage-efficient format. The user 
can begin to view the enhanced frames as soon as they are transferred and while the 
remainder of the enhanced frames are being transferred. If the request for enhanced frames 
occurred during the transfer of unenhanced frames, the transfer of unenhanced frames is 

5 interrupted until the enhanced frames are transferred, and then resumed after the transfer of 
enhanced frames is completed. 

The present invention has been described in terms of specific embodiments 
incorporating details to facilitate the understanding of the principles of construction and 
operation of the invention. Such reference herein to specific embodiments and details thereof 
W is not intended to limit the scope of the claims appended hereto. It will be apparent to those 

f: skilled in the art that modifications may be made in the embodiment chosen for illustration 
without departing from the spirit and scope of the invention. Specifically, it should be 

=C apparent to those skilled in the art, that while the video system of the present invention is 

ilj preferably used to transmit and display a video movie generated by a medical test device, the 
1^5 video system of the present invention can also be used to transmit and display any other type 
of video movie, image or series of images. 
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CLAIMS 

We Claim: 

1 1 . A method of transmitting a video stream of images from a source device to a 

2 receiving device comprising the steps of: 

3 a. transmitting the video stream of images in a first format to the receiving 

4 device; 

5 b. receiving a request for an enhanced version of a marked portion of the video 
63 stream of images from the receiving device; and 

7e; c. transmitting the marked portion of the video stream of images in a second 

8 J format, wherein the second format represents an enhanced version of the first 

9F format. 

1: 2. The method as claimed in claim 1 further comprising the step of storing the 

2^ original video stream of images at the receiving device. 

r^; 3. The method as claimed in claim 2 further comprising the step of storing the 

2 marked portion of the video stream of images to replace a corresponding portion of the 

3 original video stream of images. 

1 4. The method as claimed in claim 1 further comprising the step of generating the 

2 video stream of images and transmitting the video stream of images to the source device. 

1 5. The method as claimed in claim 4 wherein the step of generating is performed 

2 by a medical test device which is one of the group of an ultrasound, sonogram and 

3 echocardiogram device. 
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1 6. The method as claimed in claim 1 further comprising the step of displaying the 

2 video stream of images at the receiving device. 

1 7. The method as claimed in claim 6 further comprising the step of marking the 

2 marked portion of the video stream of images at the receiving device. 

1 8. The method as claimed in claim 6 wherein the step of displaying includes a 

2 fast-forward and rewind function. 

1^3 9. The method as claimed in claim 6 wherein the step of transmitting the video 

2|:; stream of images and the step of displaying are performed simultaneously such that a received 

3;^ portion of the video stream of images is displayed while a remaining portion of the video 

4;^ stream of images is transmitted. 

10. The method as claimed in claim 1 further comprising the step of adding 

2=^ annotations to the video stream of images. 

1 t 11. The method as claimed in claim 1 further comprising the step of determining if 

2 a user views a particular image within the video stream of images for a predetermined period 

3 of time and automatically transmitting the particular image in the second format. 

1 12. The method as claimed in claim 1 wherein if the request for an enhanced 

2 version is received while the step of transmitting the video stream of images is being 

3 performed, then the step of transmitting the video stream of images is paused while the step 

4 of transmitting the marked portion is performed, and resumed once the step of transmitting 

5 the marked portion is completed. 
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1 13. A transmitting device for transmitting a video stream of images to a receiving 

2 device comprising: 

3 a. a storage device configured for receiving and storing a stream of images; and 

4 b. a controller coupled to the storage device and configured for coupling to the 

5 receiving device for controlling transmission of the stream of images from the 

6 storage device to the receiving device, wherein the stream of images are 

7 transmitted to the receiving device in a first format and then a requested 

8 portion of the stream of images are transmitted to the receiving device in a 

9 second format, and further wherein the second format represents an enhanced 
103 version of the first format. 

l:JJ 14. The transmitting device as claimed in claim 13 further comprising a source 

2F device coupled to the storage device for generating the stream of images and transmitting the 

3|i| stream of images to the storage device. 

m 15. The transmitting device as claimed in claim 14 wherein the source device is a 

2;^ medical test device which is one of an ultrasound, a sonogram and an echocardiogram. 

1 16. The transmitting device as claimed in claim 14 further comprising a network 

2 interface circuit coupled to the storage device and to the controller for communicating with 

3 the receiving device over a network. 

1 17. The transmitting device as claimed in claim 16 wherein the receiving device 

2 includes a display for displaying the stream of images and an input device for marking the 

3 requested portion of the stream of images. 
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1 18. The transmitting device as claimed in claim 17 wherein the network is an 

2 Internet Protocol network. 

1 19. The transmitting device as claimed in claim 17 wherein received frames within 

2 the stream of images are displayed at the receiving device while a remaining portion of the 

3 stream of images is transmitted. 

1 20. The transmitting device as claimed in claim 17 wherein the receiving device 

2 further includes a received storage device for storing the stream of images. 

1 E; 21. The transmitting device as claimed in claim 20 wherein the requested portion of 

2 J:' the stream of images is stored in the second format and a remaining portion of the stream of 
3:p images is stored in the first format at the received storage device. 

1;' 22. A system for transmitting a video stream of images from a source device to a 



2^ 


receiving 


device comprising: 


M 


a. 


a source device for generating the video stream of images; 




b. 


a transmitting device coupled to the source device to receive and store the 


5" 




video stream of images; and 


6 


c. 


a receiving device coupled to the transmitting device to receive the video 


7 




stream of images in a first format, display the video stream of images for a 


8 




user to mark one or more sections of interest, transmit a request for an 


9 




enhanced version of the sections of interest and receive from the transmitting 


10 




device the sections of interest within the video stream of images in a second 


11 




format, wherein the second format represents an enhanced version of the first 


12 




format. 
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1 23. The system as claimed in claim 22 wherein the source device is a medical test 

2 device which is one of an ultrasound, a sonogram and an echocardiogram. 

1 24. The system as claimed in claim 22 wherein the receiving device is coupled to 

2 the transmitting device through a network. 

1 25, The system as claimed in claim 22 wherein the receiving device includes a 

2 display for displaying the stream of images and an input device for marking the requested 

3 portion of the stream of images. 

1^ 26. The system as claimed in claim 25 wherein the receiving device further 

2;iJ includes a received storage device for storing the video stream of images. 

l'^ 27. The system as claimed in claim 26 wherein the sections of interest within the 

2^ video stream of images are stored in the second format and a remaining portion of the video 
stream of images is stored in the first format at the received storage device. 

1 B 28. The system as claimed in claim 22 wherein received frames within the video 

2 stream of images are displayed at the receiving device while a remaining portion of the video 

3 stream of images is transmitted. 

1 29. A method of transmitting a video stream of images from a source to a 

2 receiving device for display and storage at the receiving device comprising the steps of: 

3 a. transmitting the video stream of images in a first format to the receiving 

4 device; 

5 b. displaying the video stream of images in the first format at the receiving 

6 device, allowing a user to mark sections of interest within the video stream of 

7 images; and 
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8 c. transmitting the sections of interest to the receiving device in a second format, 

9 wherein the second format represents an enhanced version of the first format. 

1 30. The method as claimed in claim 29 further comprising the step of displaying 

2 the sections of interest in the second format at the receiving device, 

1 31. The method as claimed in claim 30 further comprising the step of storing the 

2 sections of interest in the second format and a remaining portion of the video stream of 

3 images in the first format at the receiving device. 

1 |f 32. The method as claimed in claim 31 wherein the step of transmitting the video 

2:£; stream of images and the step of displaying the video stream of images in the first format are 

3=C performed simultaneously, such that a received portion of the video stream of images is 

4i|| displayed while a remaining portion of the video stream of images is transmitted. 

1M= 33. The method as claimed in claim 32 wherein the step of displaying includes a 

2^ fast-forward and rewind function. 

1 34. The method as claimed in claim 29 further comprising the step of generating 

2 the video stream of images and transmitting the video stream of images to the source device. 

1 35. The method as claimed in claim 34 wherein the step of generating is performed 

2 by a medical test device which is one of a group of an ultrasound, sonogram and 

3 echocardiogram device. 
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A method of and apparatus for transmitting video images allows a viewer to receive at 
a receiving display device, all or a selected portion of a video stream of frames, in a storage- 
efficient format from a transmitting device and view the received video stream of frames 
before the transmission is complete. The video system also allows a viewer to receive at the 
receiving device, all or a selected portion of a video stream of frames, in a high-resolution 
format, by marking sections of interest within the received stream of frames in the storage- 
efficient format and requesting enhancement of those marked sections of interest. This 
apparatus preferably includes a source device, a transmitting device and at least one receiving 
device. Preferably, the transmitting device and the receiving device communicate over a 
network such as the Internet Protocol network. Alternatively, the transmitting device and the 
receiving device communicate over any appropriate data network. The transmitting device 
transmits the video images to the receiving device for display and storage at the receiving 
device. The receiving device is also capable of communicating with the transmitting device 
while simultaneously receiving video images. The source device is preferably a medical test 
device such as an ultrasound, a sonogram, an echocardiogram, and the like. Alternatively, the 
source device can be any video capture or storage device capable of sourcing a stream of 
video frames. 
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